Some Properties of Bell–sejnowski Pdf-matching Neuron
نویسنده
چکیده
The aim of the present paper is to investigate the behavior of a single-input single-unit system, learning through the maximum-entropy principle, in order to understand some formal property of Bell-Sejnowski’s PDF-matching neuron. The general learning equations are presented and two casestudy are discussed with details.
منابع مشابه
Blind deconvolution, information maximization and recursive filters
Starting from maximizing information ow through a nonlinear neuron Bell and Sejnowski derived adaptation equations for blind deconvolution using an FIR lter [1]. In this paper we will derive a simpler form of the adaptation and we will apply it to more complex lter structures, such as recursive lters. As an application, we study blind echo cancellation for speech signals. We will also present a...
متن کاملFlexible estimation of probability and cumulative density functions
Introduction: Probability density function (PDF) estimation is a very important issue in several interesting areas, such as blind signal processing and adaptive data processing. The estimation of the PDF or the cumulative density function (CDF) through use of an easy and fast method becomes a very important task. Several approaches exist [1] such as maximum likelihood estimation, kernel estimat...
متن کاملA Berger-Levy Energy Efficient Neuron Model with Unequal Synaptic Strengths
How neurons in the cerebral cortex process and transmit information is a long-standing question in systems neuroscience. To analyze neuronal activity from an information-energy efficiency standpoint, Berger and Levy calculated the maximum Shannon mutual information transfer per unit of energy expenditure of an idealized integrateand-fire (IIF) neuron whose excitatory synapses all have the same ...
متن کاملBlind separation and blind deconvolution: an information-theoretic approach
INFORMATION-THEORETIC APPROACH Anthony J. Bell and Terrence J. Sejnowski Computational Neurobiology Laboratory, The Salk Institute, 10010 N. Torrey Pines Road, La Jolla, California 92037
متن کامل1 A Priori MaxEnt H ( S ) independent class analysis ( ica ) vs
Two mirror symmetric versions of the maximum entropy (MaxEnt) methodology are introduced and compared: (1) A posteriori MaxEnt Independent Component Analysis (ICA) H(V) was proposed by Bell, Sejnowski, Amari, Oja (BSAO) (early by Jutten & Herault, Comon and Cardoso (JHCC) in France). It is ambitious to factorize the unknown joint-probability density function (j-pdf) using the post processing al...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001